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DETAILED ACTION 

Priority 

1 : Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), 
which papers have been placed of record in the file. 

Claim Rejections - 35 USC § 101 

2. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or 
composition of matter, or any new and useful improvement thereof, may obtain a 
patent therefor, subject to the conditions and requirements of this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for 
Patent Subject Matter Eligibility" (Official Gazette notice of 22 November 2005), 
Annex IV, reads as follows: 



Descriptive material can be characterized as either "functional descriptive material" or 
"nonfunctional descriptive material." In this context, "functional descriptive material" 
consists of data structures and computer programs which impart functionality when 
employed as a computer component. (The definition of "data structure" is "a physical 
or logical relationship among data elements, designed to support specific data 
manipulation functions." The New IEEE Standard Dictionary of Electrical and 
Electronics Terms 308 (5th ed. 1993).) "Nonfunctional descriptive material" includes 
but is not limited to music, literary works and a compilation or mere arrangement of 
data. 

When functional descriptive material is recorded on some computer-readable 
medium it becomes structurally and functionally interrelated to the medium and will 
be statutory in most cases since use of technology permits the function of the 
descriptive material to be realized. Compare In re Lowry, 32 F.3d 1579, 1583-84, 32 
USPQ2d 1031, 1035 (Fed. Cir. 1994) (claim to data structure stored on a computer 
readable medium that increases computer efficiency held statutory) and Warmerdam, 
33 F.3d at 1360-61, 31 USPQ2d at 1759 (claim to computer having a specific data 
structure stored in memory held statutory product-by-process claim) with 
Warmerdam, 33 F.3d at 1361, 31 USPQ2d at 1760 (claim to a data structure per se 
held nonstatutory). 

In contrast, a claimed computer-readable medium encoded with a computer program 
is a computer element which defines structural and functional interrelationships 
between the computer program and the rest of the computer which permit the 
computer program's functionality to be realized, and is thus statutory. See Lowry, 32 
F.3d at 1583-84, 32 USPQ2d at 1035. 
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Claim 17 is rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter as follows. Claim 17 defines a computer 
program embodying functional descriptive material. However, the claim does not 
define a computer-readable medium or computer-readable memory and is thus 
non-statutory for that reason (i.e., 'When functional descriptive material is 
recorded on some computer-readable medium it becomes structurally and 
functionally interrelated to the medium and will be statutory in most cases since 
use of technology permits the function of the descriptive material to be realized" - 
Guidelines Annex IV). The scope of the presently claimed invention 
encompasses products that are not necessarily computer readable, and thus 
NOT able to impart any functionality of the recited program. The examiner 
suggests amending the claim(s) to embody the program on "computer-readable 
medium" or equivalent such as "A computer readable medium stores a program 
..."; assuming the specification does NOT define the computer readable medium 
as a "signal", "carrier wave", or "transmission medium" which are deemed non- 
statutory (refer to "note" below). Any amendment to the claim should be 
commensurate with its corresponding disclosure. 
Note: 

A "signal" (or equivalent) embodying functional descriptive material is 
neither a process nor a product (i.e., a tangible "thing") and therefore does not 
fall within one of the four statutory classes of § 1 01 . Rather, "signal" is a form of 
energy, in the absence of any physical structure or tangible material. 
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Should the full scope of the claim as properly read in light of the disclosure 
encompass non-statutory subject matter such as a "signal", the claim as a whole 
would be non-statutory. In the case where the specification defines the computer 
readable medium or memory as statutory tangible products such as a hard drive, 
ROM, RAM, etc, as well as a non-statutory entity such as a "signal", "carrier 
wave", or "transmission medium", the examiner suggests amending the claim to 
include the disclosed tangible computer readable media, while at the same time 
excluding the intangible media such as signals, carrier waves, etc. 



Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 
U.S.C. 102 that form the basis for the rejections under this section made in this 
Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a 
printed publication in this or a foreign country, before the invention thereof by the applicant 
for a patent. 

(b) the invention was patented or described in a printed publication in this or a foreign 
country or in public use or on sale in this country, more than one year prior to the date of 
application for patent in the United States. 

(e) the invention was described in (1) an application for patent, published under section 
122(b), by another filed in the United States before the invention by the applicant for 
patent or (2) a patent granted on an application for patent by another filed in the United 
States before the invention by the applicant for patent, except that an international 
application filed under the treaty defined in section 351 (a) shall have the effects for 
purposes of this subsection of an application filed in the United States only if the 
international application designated the United States and was published under Article 
21(2) of such treaty in the English language. 



4. Claims 1-2, 5, 8, 9-10, 13, and 16-17 are rejected under 35 U.S.C. 102(b) 
as being anticipated by Center, JR. (US 2003/0059124 A1). 
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Regarding claims 1 (method), 9 (apparatus), and 17 (program), Center 
discloses a metadata generation system comprising: 

clipping a plurality of different local areas of said image (as depicted in figure 1 , 
numerals 28 and 30 to find head and eye, respectively); 
extracting frequency features for the respective local areas ("The invention 
advantageously uses a transformation into the frequency domain to more 
efficiently correlate the acquired image with the set of stored images" in 
paragraph 9, line 4. See also figure 9, numeral 330 "The system then normalizes 
the unknown facial image, as set forth in step 330 ... and converts the 
normalized image data into the frequency domain using DFFT 21 0B ..." in 
paragraph 99, line 1); 

projecting feature vectors, which are vectors consisting of said frequency 
features, onto predefined subspaces; thereby extracting the projected feature 
vectors of the respective local areas so as to generate the projected feature 
vectors as face metadata (as depicted in figure 1 , numeral 36: "The actual 
encoding or compression process can employ a Karhunen-Loeve transformation 
or an eigenvector projection technique, which encodes an image of a person's 
face or other facial feature, such as nose, eyes, lips, and so forth, as a weighted 
set of eigenvectors ... an image of a face is projected onto a face space defined 
by a set of reference eigenvectors. The reference set of eigenvectors, or 
eigenfaces, can be thought of as a set of features which together characterize 
the variation between face images within a reference set of facial images. This 
distribution of faces in the reference set of faces can be characterized by using 
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principal component analysis to extract face information that characterizes the 
variations or differences between a newly acquired image (the projected image) 
and the eigenfaces ... Once the eigenfaces are identified an image signal can be 
represented as a function of these eigenfaces by projecting the image signal into 
the space defined by these eigenfaces" in paragraph 110, line 8). 

Regarding claims 2 and 10, power spectral intensities of Fourier 
frequencies obtained by discrete Fourier transform are extracted as said 
frequency features (discussed in claim 1, the Discrete Fast Fourier Transform 
(DFFT) used for the analysis. Thus, the amplitudes of the DFFT coefficients, i.e. 
the power spectral intensities of DFFT, can be extracted as frequency features). 

Regarding claims 5 and 13, said subspaces are specified by basis vectors 
previously obtained by principal component analysis for frequency features, and 
frequency feature vectors are projected onto the specified subspaces to calculate 
principal component vectors (discussed in claim 1 , the principal component 
analysis (PCA) used for the subspace data processing). 

Regarding claims 8 and 16, wherein area positions corresponding to the 
respective local areas are searched as said local areas in said image, clipping 
positions are obtained, and after that, the local areas are clipped (depicted in 
figure 1 , numeral 28 to find head, numeral 30 to find eye. Figure 6 is a more 
detailed schematic representation of the primary eye find stage 30 of figure 1). 
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Claim Rejections -35 USC §103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art are such that the subject matter as a 
whole would have been obvious at the time the invention was made to a person having 
ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

6. Claims 3-4 and 11-12 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Center and Satonaka et al. (US 6,236,749 
B1). 

Regarding claims 3-4 and 11-12, Center discloses a metadata generation 
system with DFFT for the frequency features as discussed in claims 1 and 9. 
Center does not explicitly disclose DCT or DST frequency features. 

Satonaka, in the same field of endeavor of feature extraction ("recognizing 
an object in a three-dimensional space based on the feature patterns of a two- 
dimensional image" at column 1 , line 5), teaches the feature pattern 
transformation "by using a two-dimensional discrete cosine transform or a two- 
dimensional discrete sine transform, thereby obtaining frequency components in 
a two-dimensional space" at column 3, line 25. 

It would have been obvious at the time the invention was made to one of 
ordinary skill in the art to include the metadata generation system Center made 
with DCT/DST capability as taught by Satonaka, such that various frequency 
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components can be extracted and "... a number of the components maximizes 
recognition precision" at column 3, line 34. 

7. Claims 6-7 and 14-15 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Center and Philomin et al. (US 
2003/0113002 A1). 

Regarding claims 6-7 and 14-15, Center discloses a metadata generation 
system with PCA used for the subspace data processing as discussed in claims 
1 and 9. Center does not explicitly disclose ICA or LDA processing. 

Philomin, in the same field of endeavor of eigen feature study ("relates 
generally to person recognition" in paragraph 2, line 1), teaches the usefulness of 
eigenspace "... eigenface vectors can be used for identifying a person from a 
video image. In a similar manner, any method or system that generates 
eigenvoice vectors can be used for identifying or verifying the identity of a person 
from audio information. In the present invention, the face feature data and voice 
feature data for any one person are concatenated to form a composite 
eigenvector, and this composite eigenvector is used for person identification 
and/or person verification" in paragraph 21 , line 2. The dimension of voice 
supervector can be reduced "by any linear transformation that reduces the 
original high-dimensional superve^tors into voice basis vectors. A non-exhaustive 
list of examples of linear transformation includes: Principal Component Analysis 
(PCA), Independent Component Analysis (ICA), Linear Discriminant Analysis 
(LDA), Factor Analysis (FA), and Singular Value Decomposition (SVD)" in 
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paragraph 34, line 12. Furthermore, "Dimensionality reduction yields one voice 
eigenvector for each one of the training speakers ... The voice eigenvectors that 
make up the eigenvoice space each represent a different dimension across 
which different speakers may be differentiated" in paragraph 35, line 2. Without 
departing from the scope and spirit of Philomin's methodology, linear 
transformation such as PCA, ICA, and LDA can be applied to eigenface analysis. 

It would have been obvious at the time the invention was made to one of 
ordinary skill in the art to include the metadata generation system Center made 
with ICA and LDA transformation as taught by Philomin, such that "different 
speakers may be differentiated" in paragraph 35, line 9. 

8. Claim 18 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
the combination of Center and Goldberg (US 6,526,158 B1). 

Regarding claim 18, Center discloses a metadata generation system 
comprising: 

a face image input unit (1 1 ) for inputting a face image (as depicted in Center 
figure 1, numeral 22); 

a face metadata generating unit (12) for generating face metadata from an 
inputted face image (as depicted in figure 2, detection stage #50 and PCA #36); 
a face metadata storage unit (13) for storing generated face metadata therein, a 
face similarity calculating unit (14) for calculating a similarity of a face from said 
face metadata, a face image database (15) for storing said face images (as 
depicted in figure 1, numeral 34 "The image manipulation stage 34 places the 
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image in suitable condition for compression and subsequent comparison with 
pre-stored image identification information" in paragraph 36, line 9); 
a controller (16) for controlling, in response to a registration request and a 
retrieval request of the image, input of the image, generation of the metadata, 
storing of the metadata, and calculation of face similarity (as depicted in figure 1, 
numerals 26 and 34 "the frame grabber 26 is conventionally configured to 
capture and digitize image frames" in paragraph 39, line 7. See also "frame 
grabber 26 produces a digitized frame output signal 44 which is operatively 
communicated with multiple locations ..." in paragraph 40, line 1. "The image 
manipulation stage 34 places the image in suitable condition for compression 
and subsequent comparison with pre-stored image identification information" in 
paragraph 36, line 9); 

area clipping means (121) for clipping local areas of said face image (as depicted 
in figure 1 , numerals 28 and 30); 

frequency feature extracting means (122) for extracting frequency features for 
the areas clipped by said area clipping means (as depicted in figure 1, numeral 
34 and figure 9, numerals 315, 330); 

vector projection means (123) for projecting feature vectors, which are vectors 
consisting of the frequency features extracted by said frequency feature 
extracting means, onto predefined subspaces (as depicted in figure 1 , numeral 
36 "compression stage 36, which can be a principal component analysis 
compression stage. This stage produces eigenvectors from a reference set of 
images projected into a multi-dimensional image space. The vectors are then 
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used to characterize the acquired image. The compression stage 36 in turn 
generates an output signal which serves as an input to a discrimination stage 38, 
which determines whether the acquired image matches a pre-stored image" in 
paragraph 36, line 13). 

Center does not explicitly disclose a display system. 

Goldberg, in the same field of endeavor of person identifier ("digital 
identifier of the person whose representation is stored" at column 2, line 60), 
teaches in figure 4e "The image of the face of patron 43 is analyzed for features 
particular to that face, including the distances between different features (such as 
eyes, base of the nose, and the center of the mouth), and more abstract metrics 
such as the eigenface and eigenfeature decomposition of the face" at column 1 1 , 
line 60. Furthermore, figure 2: "Once the patron 43 is identified, the images 
corresponding to the patron 43 may be retrieved from the image storage device 
71 , and the images projected onto the viewing screen 85 for the patron to review 
..." at column 15, line 46. 

It would have been obvious at the time the invention was made to one of 
ordinary skill in the art to include the metadata generation system Center made 
with a display unit as taught by Goldberg so that the user can review the result. " 

Conclusion 

9. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Eueng-nan Yeh whose telephone number is 
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571-270-1586. The examiner can normally be reached on Monday-Friday 8AM- 
4:30PM EDT. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Vikkram Bali can be reached on 571-272-7415. The fax 
phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 

Eueng-nan Yeh 
Assistant Patent Examiner 
Art Unit: 2624 



